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BRIEF 


Requirement: 

To  determine  the  effect  of  bandwidth  compression  on  the  interpret- 
ability  of  digitized  imagery. 


Procedure : 

Twelve  experienced  image  interpreters  were  given  about  3  hours  of 
practice/training  on  digitized  imagery  containing  all  the  different  con¬ 
ditions  in  the  experiment.  Each  participant  then  interpreted  all  the 
imagery  in  each  of  three  "resolution  sets";  first,  8-inch  ground-resolved 
distance  (GRD) ,  vertical  imagery;  second,  16-inch  GRD,  vertical  imagery; 
and  third,  24-inch  GRD,  oblique  imagery.  Each  set  was  divided  into  four 
subsets  of  images,  each  of  which  could  be  viewed  at  one  of  the  four  levels 
of  bandwidth  compression— 1 : 1  (no  compression),  4:1;  8:1;  and  10:1. 

To  test  the  effects  of  bandwidth  compression,  a  Greco-Latj n  square 
design  was  used  to  control  for  differences  between  interpreters,  imagery 
subsets,  and  periods  at  each  GRD.  In  the  24— inch  GRD  (oblique  imagery) 
target  difficulty  was  controlled  to  allow  testing  the  effects  of  sun 
angle,  image  contrast,  target  obscurity,  bandwidth  compression,  and  their 
interactions  on  interpreter  performance.  At  the  other  two  GRDs,  the  first 
three  variables  were  distributed  equally  across  bandwidth  compression,  but 
could  not  be  analyzed  because  of  confounding  with  target  differences  in 
the  imagery.  The  number  of  correct  identifications  and  number  of  misiden- 
tifications  were  analyzed  for  each  of  five  reporting  levels  of  increasing 
detail  of  target  identification — from  simple  detection  (i.e.,  was  a  tar¬ 
get  present?)  to  the  model  number  of  target  (e.g.,  self-propelled  gun, 

M107)  . 


Findings : 

In  general,  the  number  of  right  responses  decreased  significantly 
as  bandwidth  compression  increased  For  each  resolution  set  (8-inch,  16- 
inch,  and  24-inch  GRD) ,  but  not  for  each  level  of  detail  of  target  iden¬ 
tification.  The  largest  decrease  in  right  responses  was  from  the  second 
compression  level  (4:1)  to  the  third  compression  level  (8:1).  Wrong 
identifications  also  tended  to  decrease  as  bandwidth  compression 
increased. 


VI  L 


Significant  differences  were  found  for  target  obscurity  (only  a  few 
hidden  targets  were  found)  and  for  sun  angle  (high  sun  angle  was  better) . 
Some  interactions  were  found  between  bandwidth  compression  and  sun  angle 
and  target  obscurity.  For  example,  under  the  low-sun-angle  condition, 
the  largest  decrease  in  the  number  of  right  identifications  due  to  band¬ 
width  compression  occurred  at  4:1  compression  level,  whereas  in  the  high- 
sun-angle  condition,  the  largest  decrease  occurred  between  4:1  and  8:1 
compression  levels. 

Utilization  of  Findings: 

Bandwidth  compression  of  digitized  imagery  degrades  interpreter  per¬ 
formance.  Users  should  carefully  consider  the  trade-offs  between  differ¬ 
ent  amounts  uf  bandwidth  compression  and  the  degradation  of  interpreter 
performance.  Developers  of  systems  using  bandwidth  compression  should 
collect  more  data  concerning  its  effect  on  search  performance  of  trained 
interpreters  using  large  format  imagery  if  more  exact  trade-off  analyses 
are  required. 

Users  and  developers  of  such  systems  also  should  collect  more  data 
on  the  impact  of  the  operational  conditions  (such  as  sun  angle)  to  deter¬ 
mine  when  bandwidth  compression  will  be  most  effective  and  when  it  should 
not  be  used. 
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INTRODUCTION 

The  transmission  of  continuous-tone  imagery  in  digital  form  is  of 
great  interest  to  the  Department  of  Defense  for  several  specific  applica¬ 
tions.  One  such  application  is  the  near-real -time  transmission  of  sur¬ 
veillance  imagery  to  ground  terminals.  This  is  a  prime  requirement  of 
intelligence  and  command-and-control  systems,  since  much  of  the  military 
information  contained  in  such  imagery  is  extremely  perishable.  One  dif¬ 
ficulty  associated  with  the  real-time  transmission  of  imagery  is  the 
direct  relation  between  image  resglution  and  the  bandwidth  used  for  trans¬ 
mission.  However,  large  bandwidth  requirements  are  a  serious  problem  for 
many  reasons — for  example,  the  bandwidth  requirements  of  other  systems, 
antenna  size,  interference  with  other  systems,  time  for  transmission,  and 
jamming  considerations.  Unfortunately,  reduced  bandwidth  and  image  degra¬ 
dation  (and  other  problems)  are  inseparably  linked  in  the  real-time  trans¬ 
mission  of  imagery. 

A  possible  solution  to  this  problem  is  the  use  of  bandwidth  compres¬ 
sion.  In  this  method,  the  digitized  image  is  transformed  to  the  frequency 
domain  where  many  of  the  higher  frequencies — possessing  little  image  en¬ 
ergy — are  discarded.  Theoretically,  a  minimum  amount  of  image  information 
is  lost,  and  bandwidth  requirements  are  reduced. 


OBJECTIVE 

The  research  objective  was  to  determine  the  information  loss  asso¬ 
ciated  with  different  degrees  of  bandwidth  compression  in  image  transmis¬ 
sion.  More  specifically,  this  research  investigated  the  effect  of  levels 
of  bandwidth  compression  of  digitized  imagery  on  the  number  of  right  and 
wrong  target  identifications  made  by  image  interpreters  for  variations  in 
operational  conditions  such  as  vertical  and  oblique  imagery,  image  resolu¬ 
tion,  sun  angle,  image  contrast,  and  target  obscurity. 


METHOD 


Sample  -v 

Twelve  experienced  Image  interpreters  of  the  'J.S.  Army  image  Inter¬ 
pretation  Center,  Washington,  D.C.,  participated  in  the  experiment.  The 
interpreters  varied  widely  in  age,  experience,  and  rank,  but  the  sample 
distribution  could  not  be  controlled  to  represent  a  particular  population 
of  image  interpreters. 


1 


Procedure 


The  12  image  interpreters  were  first  given  an  introduction  describ¬ 
ing  the  background  of  the  experiment  (Appendix  A)  and  instructions  on  use 
of  the  Vehicle  Target  List,  U.S.  Equipment  Mini-key,  and  the  Report  Form 
(Appendix  B) .  To  insure  that  the  interpreters  understood  the  instructions 
and  to  provide  practice  in  interpreting  digital  imagery  of  scenes  portray¬ 
ing  American  equipment  processed  with  bandwidth  compression,  they  next 
interpreted  10  vertical  images  containing  two  to  three  targets  per  image. 
This  first  set  represented  imagery  with  a  ground-resolved  distance  (GRD) 
of  8  inches  prior  to  compression  and  processing.  After  interpreting  6  to 
10  targets  at  one  compression  level,  they  scored  themselves,  checked  their 
interpretations,  and  proceeded  to  a  different  compression  level  until  they 
completed  practice  at  all  four  compression  levels  and  on  targets  ft  m  all 
four  major  target  categories.  This  procedure  was  repeated  with  10  more 
vertical  images  with  a  16-inch  GRD  before  compression  and  processing.  In¬ 
terpreters  then  received  10  oblique  images  (optical  axis  60  degrees  from 
the  horizontal)  with  a  24-inch  GRD  before  compression  and  processing,  and 
the  same  procedure  was  repeated.  In  this  manner,  the  interpreters  re¬ 
ceived  practice  on  all  procedures  necessary  for  data-collection ,  on  the 
use  of  the  mini-key,  on  all  target  types  employed,  on  all  ground  resolu¬ 
tions,  and  on  all  levels  of  bandwidth  compression. 

On  tiie  second  day  the  interpreters  received  a  short  description  of 
test  procedures  and  imagery  (Appendix  C)  and  began  interpreting  the  im¬ 
agery.  They  worked  for  about  50  minutes  on  each  set  of  imagery  (8-incii, 
16-inch,  and  24-inch  GRD),  with  a  10-minute  break  between  sets. 


Variables 

Dependent  Variables.  Two  primary  dependent  variables  were  used — 
number  of  right  identif ications  and  number  of  wrong  identifications.  The 
wrong  score  was  composed  mainly  of  misidentif ications  (i.e.,  giving  the 
wrong  name  to  a  vehicle),  but  included  some  inventive  errors  (i.e.,  iden¬ 
tifying  a  nonmilitary  object  as  a  military  vehicle).  Both  scores  were 
derived  at  five  levels  of  reporting  detail  ranging  from  detection  (Level  I: 
military  object  versus  nonmilitary  object)  to  detailed  interpretation 
(Level  V:  model  number  of  object) .  Appendix  B  provides  a  detailed  de¬ 
scription  of  the  five  levels. 


The  image  interpreters  reported  targets  at  the  most  detailed  level 
they  thought  appropriate  and  were  scored  not  only  for  this  reporting 
level,  but  for  all  less-detailed  reporting  levels.  Thus,  an  interpreter 
could  report  ar.  object  at  Reporting  Level  V  and  be  scored  wrona  at  this 
level,  also  be  scored  wrong  at  Level  IV,  but  be  scored  right  at  levels 
III,  II,  and  I. 
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Independent  Variables.  Seven  independent  variables  were  employed: 

1.  Bandwidth  compression  level.  Four  leve1 s  of  compression  were 
used;  8+  bits/pel  (pel  =  picture  element) — this  level  had  zero  bandwidth 
compression;  2  bits/pel — 4:1  bandwidth  compression;  1  bit/pel — 8:1  band¬ 
width  compression;  and  .8  bit/pel — 10:1  bandwidth  compression. 

2.  Groups  of  interpreters.  Four  groups  of  t)  ree  interpreter^  each 
were  established.  Groups  were  matched  subjectively  for  abil\  ty  by. their 

■  i  ' '  •  / 

supervisors. 

3.  Periods.  Four  work  periods  (first,  seconu,  third,  and  fourth) 
were  used  to  control  for  time-related  effects  such  as  practice  and 
fatigue . 

4.  Scenario.  Four  scenarios  were  used;  each  scenario  consisted  of 
an  image  matrix  of  10  image  chips  (8  chips  scorable) . 

5.  Target  obscurity.  In  the  third  experiment,  )  ith  24-inch  GRD  im¬ 
agery,  half  the  targets  imaged  were  in  the  open  and  the  other  half  were 
visible  but  embedded  in  vegetation.1 

6.  Sun  angle.  In  the  third  experiment,  half  the  imagery  was  taken 
with  a  sun  angle  of  62  degrees  from  the  horizontal,  and  the  other  half  of^ 
the  imagery  was  taken  with  a  sun  angle  of  18  degrees  from  the  horizontal. 

7.  Contrast.  In  the  third  experiment,  half  the  imagery  was  processed 
to  produce  a  nigh-contrast  image  (i.e.,  with  dense  black  shadow),  and  the 
other  half  was  processed  to  produce  low-contrast  images  (i.e.,  with  light 
but  visible  shadows) .  No  physical  measurements  of  the  resulting  contrast 
levels  were  made.1 


Design 

To  simplify  the  research  design,  each  of  the  three  ground  resolutions 
was  considered  as  separate  experiment:  I,  8-inch  GRD;  II,  16-inch  GRD; 
and  III,  24-inch  GRD.  An  identical  Greco-Latin  square  was  used  in  each 
experiment  to  counterbalance  the  independent  variables — groups,  scenarios, 
periods,  and  bandwidth  compression  levels  (Table  1) .  A  2  x  2  x  2  arranae- 
ment  of  the  image  variables — sun  angle,  contrast,  and  target  obscurity-- 
was  present  in  each  scenario,  as  shown  in  Table  2.  Since  each  image  con¬ 
tained  different  targets,  image  variables  became  confounded  with  target 


In  experimer '  3,  the  imagery  was  obtained  in  the  laboratory  using  models 

wherein  target  difficulty  and  image  variables  could  be  controlled.  In 
experiments  1  and  2,  the  imagery  was  selected  from  a  library  of  U.S.  Army 
maneuver  photography;  the  judgment  of  interpreters  and  "take"  conditions 
were  used  to  define  the  target  difficulty  and  image  variables. 


type  and  were  not  analyzed  for  the  8-inch  and  16-inch  imagery.  However, 
for  the  24-inch  ground  resolution  imagery,  sufficient  control  of  target 
type  was  possible  to  roughly  equalize  estimated  target  difficulty  across 
these  variables;  hence,  an  analysis  could  be  performed  for  24-inch  GRD 
imagery  without  serious  confounding  (see  Table  3).  A2x2x2x4  fac¬ 
torial  analysis  of  variance  design  was  used  to  investigate  the  variables-- 
sun  angle,  contrast,  target  obscurity,  bandwidth  compression  level — and 
their  interactions. 


Table  1 

Greco-Latin  Square  Design 


Group 

Period 

1 

2 

3 

4 

G1 

Vh 

VS4 

VS3 

Vh 

G2 

Vh 

Vs  2 

VS1 

Vh 

G3 

VS4 

VS1 

VS2 

VS3 

G4 

Vh 

VS3 

VS4 

Vh 

Note  : 

T  -  bandwidth 

compression 

level;  S 

=  scenario 

Theoretically,  each  of  the  above  analyses  could  have  been  carried 
out  for  each  of  the  five  reporting  levels  and  for  each  of  the  dependent 
variables  (right  identification  and  wrong  identifications).  In  some  cases, 
however,  insufficient  data  were  available  for  analysis,  e.g.,  right  iden¬ 
tifications  at  the  level  of  greatest  target  detail  (Reporting  Level  V) . 


Stimulus  Materials 


Four  sets  of  scenarios  for  each  experiment  were  constructed  to  meet 
experimental  design  considerations  while  simulating  operational  condi¬ 
tions.  Each  scenario  consisted  of  an  image  mosaic  of  10  image  chips 
(positive  transparencies) .  Eight  of  these  image  chips  contained  from 
one  to  six  targets  and  were  used  to  obtain  the  experimental  data.  The 
other  two  chips  contained  no  targets  and  were  included  to  reduce  the 
attractiveness  of  guessing;  any  reports  made  for  these  chips  were  not 
used  in  the  analyses. 
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Variables  Within  Each  scenario 


The  chips  were  arranged  in  the  image  mosaic  as  shown  in  Appendix  D 
(Figure  D-l) .  The  lower  position  of  the  mosaic  contained  a  rectangular 
array  of  numbers.  The  numbers  in  the  top  row  were  mosaic  identification 
numbers,  and  the  numbers  in  the  lower  four  rows  were  the  image  identifi¬ 
cation  numbers  corresponding  to  the  10  image  chips . 

Each  of  the  eight  chips  containing  targets  represented  one  combina¬ 
tion  of  the  bilevel  independent  variables — sun  angle,  contrast,  and  tar¬ 
get  obscurity.  An  attempt  was  made  to  insure  that  at  least  two  chips 
contained  one  target  each  from  the  four  major  target  categories  (tracked 
vehicles — armor,  wheeled  vehicles,  engineer  equipment;  and  miscellaneous 
trailers,  towed  artillery,  or  aircraft).  Thus,  each  scenario  represented 
a  wide  variety  of  operational  conditions. 

Actually,  only  the  24-inch  resolution  scenarios  (Table  3)  met  these 
specifications  sufficiently  for  analysis  purposes.  These  scenarios  were 
photographed  using  detailed  target  models  displayed  on  a  realistic  ter¬ 
rain  board  of  1:80  scale,  to  obtain  the  desired  distribution  of  conditions 
The  8-inch  and  16-inch  GRD  scenarios  (vertical  photography)  used  imagery 
photographed  over  the  Camp  Drum  Military  Reservation  in  upper  New  York 
State.  This  imagery  contained  few  target  objects  of  engineer  equipment 
or  of  the  miscellaneous  category,  but  it  did  satisfy  most  of  the  other 
design  requirements. 

A  few  gaps  in  the  desired  design  of  scenarios  occurred  because  of 
the  lack  of  suitable  imagery  or  because  of  problems  concerning  image 
digitization.  Appendix  D  gives  the  image  matrix  and  tragets  contained 
in  each  image.  A  complete  discussion  of  the  details  of  the  digitization 
and  bandwidth  compression  (two-dimensional  cosine  transform)  of  the 
is  given  in  Butler,  et  al. ,  1975. 2 


RESULTS 

The  Greco-Latin  square  design  controlled  for  differences  among  inter¬ 
preters,  scenarios,  and  periods  in  testing  the  effects  of  bandwidth  com¬ 
pression  on  interpreter  performance.  Data  are  presented  in  this  section 
only  for  the  bandwidth  compression  variable.  The  data  and  results  for 
each  experiment  for  the  control  variables — groups,  scenarios,  and  periods- 
appear  in  Appendix  E. 

For  each  situation  where  the  bandwidth  compression  variable  produced 
a  significant  change  in  interpreter  performance ,  the  differences  in  mean 
performance  between  the  four  levels  wore  tested  using  the  Newman-Keuls 
Tent.  (See  Appendix  F  for  dotailed^resul ts . ) 


‘'Muller,  J.  ,  Di Russo,  E.,  Martinson,  1..,  Kuditick,  J. ,  and  Wild,  G. 

(U)  Digital  Data  Transmission  System  Study  (SECRET).  RCA  Government 
Communications  Systems  Division,  Contract  DACA  7G-75-C-0003 ,  for  U.S. 
Army  Engineer  Topographic;  Laboratories.,  17  December  1975. 


The  results  of  the  analyses  of  variance  for  the  three  parallel  ex¬ 
periments  (8-inch  GRD ,  16-inch  GRD,  and  24-inch  GRD)  are  reported  sepa¬ 
rately — first  for  the  right  identifications  for  each  reporting  level  and 
then  for  the  wrong  identifications  for  each  reporting  level.  Next,  addi¬ 
tional  analyses  concerning  the  image  variables  and  bandwidth  compression 
are  given  for  the  24-inch  GRD  imagery.  Finally,  the  results  are  summar¬ 
ized  across  the  three  experiments. 


Eight-Inch  Ground  Resolution 


Right  Identification  Scores.  Table  4  shows  the  results  of  the  anal¬ 
yses  of  variance  for  the  number  of  right  identifications  for  the  indepen¬ 
dent  variables  versus  four  reporting  levels.  (Reporting  Level  V  was 
omitted  because  of  insufficient  data.)  Bandwidth  compression  level  and 
scenario  (discussed  in  Appendix  E)  were  associated  with  significant  dif¬ 
ferences  at  one  or  more  reporting  levels. 

At  Reporting  Level  I,  there  was  no  significant  deterioration  in 
performance.  At  this  level,  the  interpreter  is  making  a  target/nontarget 
judgment  for  each  spot  on  the  image  that  attracts  his  attention.  This 
decision  appears  to  be  made  with  about  the  same  level  of  proficiency  at 
all  bandwidth  levels. 


Table  4 

Analysis  of  Variance  Summary  for  Right 
Identifications,  Independent  Variables 
Versus  Reporting  Level  (8-inch  GRD) 


_ Reporting  level _ 

Independent  variable  I  II  III  IV  Va 

Groups 
Periods 

Bandwidth  compression 
level 

Scenario 

Residual 

**Signif j cant  at  the  .01  level. 

''  f  r i r ; u  IT  i  c  i.en  I.  da  ta  . 


*  * 

•k  k  "v  k  k  k  k  k  k 
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At  Reporting  Level  II,  compression  produced  a  significant  effect. 

At  this  level,  the  number  of  right  identifications  is  higher  for  the  6+ 
bits/pel  level  than  for  the  other  three  bandwidth  levels  (see  Table  5) . 

At  Reporting  Level  II,  the  interpreter  must  identify  the  class  of  vehicle-- 
tracked,  wheeled,  trailer-artillery-aircraft,  or  engineer  equipment.  The 
task  of  identifying  the  cues  and  signatures  necessary  for  successfully 
distinguishing  among  the  four  target  categories  was  significantly  affected 
by  bandwidth  compression. 

The  data  on  Reporting  Levels  III,  IV,  and  V  indicated  that  these 
mere  detailed  interpretations  were  very  difficult  to  make  at  any  level 
of  bandwidth  compression.  There  was  a  50%  reduction  in  the  number  of 
right  identifications  for  each  reporting  .level.  However,  there  were  no 
significant  differences  in  performance  due  to  bandwidth  compression. 


Table  5 

Number  of  Right  Identifications, 
Bandwidth  Compression  Level  Versus  Reporting 
Level  (8-inch  GRD) 


Bandwidth  compression 
level 

Reporting 

level 

I 

II 

III 

IV 

Va 

8+ 

bits/pel 

108 

96 

48 

22 

6 

2 

bits/pel 

100 

74 

37 

16 

8 

1 

bit/pel 

86 

60 

39 

20 

9 

0.8 

bit/pel 

93 

78 

37 

20 

7 

a 

Insufficient  data--not  analyzed. 


For  the  relatively  simple  task  of  detection  (Reporting  Level  I)  with 
the  best  quality  imagery  (8+  bits/pel) ,  the  interpreters  made  108  correct 
detections  out  of  the  165  possible;  that  is,  they  detected  about  63%  of 
the  available  targets.  This  very  low  performance  resulted  from  the  con¬ 
ditions  of  the  experiment — not  the  quality  of  the  interpreters.  Inter¬ 
preters  typically  are  not  trained  or  experienced  in  the  recognition  fac¬ 
tors  of  American  equipment  portrayed  in  the  images,  nor  on  digitized 
imagery  of  any  kind.  Additionally,  the  experimental  procedure- ,  equipment, 
and  unusual  conditions  also  could  have  reduced  the  level  of  performance. 
Since  the  experimental  imagery  did  not  include  continuous-tone  imagery  as 
a  control,  the  effect  of  digitizing  along  could  not  be  assessed.  Thus, 
although  the  relative  effects  of  bandwidth  compression  and  other  factors 
can  be  determined,  the  operational  level  of  performance  anticipated  can¬ 
not  be  assessed. 
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In  summary,  bandwidth  compression  apparently  did  not  affect  detec¬ 
tion  but  did  affect  the  first  level  of  identification.  Other  levels  of 
identifications  apparently  were  not  significantly  affected. 

Wrong  Identification  Scores.  Table  6  gives  the  result  of  the  analy¬ 
ses  of  variance  for  independent  variables  versus  the  five  reporting  levels. 
The  three  significant  variables  are  groups,  bandwidth  compression,  and 
scenarios.  Group  and  scenario  effects  are  given  in  Appendix  L. 


Table  6 

Analysis  of  Variance  Summary  for  Wrong 
Identifications,  Independent  Variables  Versus 
Reporting  Level  (8-inch  GRD) 


Reporting 

level 

Independent  variables 

Ia 

II  III 

IV 

V 

Groups 

- 

* 

Periods 

- 

Compression 

levels 

- 

★ 

Scenarios 

- 

**  *★ 

* 

*  * 

Residual 

- 

‘Significant  at  the  .05  level. 
“Signiricant  at  the  .01  level. 

a 

Insufficient  data. 


Bandwidth  compression  levels  differed  significantly  for  Reporting 
Level  III  fur  the  number  of  wrong  identif icatic  s  made.  Tabic  7  presents 
the  number  of  wrong  identifications  by  bandwidth  compression  level  and 
reporting  level.  7vt  a  compression  ratio  of  8:1  (1  bit/pel),  the  number 
of  wrong  identifications  is  much  lower  than  for  any  of  the  other  three 
compression  levels.  The  reason  for  this  is  not  known.  Compounding  the 
confusion,  performance  is  poorest  at  both  8  bits/pel  and  .8  bit/pcl. 
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Table  7 


Number  of  Wrong  Identifications,  Bandwidth 
Compression  Level  Versus  Reporting  Level  (8-inch  GRD) 


Bandwidth  compression 
level 

Reporting 

level 

Ia 

II 

III 

IV 

V 

8+ 

bits/pel 

- 

10 

34 

38 

40 

2 

bits/pel 

- 

15 

23 

32 

31 

1 

bit/pel 

- 

16 

14 

22 

25 

.8 

bit/pel 

- 

11 

31 

31 

31 

a 

Insufficient  data. 


Sixteen-Inch  Ground  Resolution 


Right  Identification  Scores.  Table  8  gives  the  analysis  of  variance 
summary  for  the  right  identifications  by  independent  variables  versus  re¬ 
porting  level.  All  the  independent  variables  were  associated  with  signif¬ 
icant  differences  at  one  or  more  of  the  reporting  levels.  In  addition,  a 
significant  residual  was  found  for  Reporting  Level  I,  indicating  that  the 
assumption  of  no  interactions  among  the  independent  variables  is  not  veri¬ 
fied.  Thus,  it  is  possible  that  two  or  more  variables  could  have  inter¬ 
acted  to  produce  a  significant  effect  in  another  one.  Only  the  compres¬ 
sion  variable  is  discussed  in  this  section;  the  other  variables  are 
described  in  Appendix  E. 

Significant  differences  (Table  8)  in  performance  due  to  bandwidth 
compression  were  found  at  each  reporting  level.  Table  9  gives  the  number 
right  identifications  for  bandwidth  compression  level  versus  reporting 
level.  The  greater  the  bandwidth  compression,  the  poorer  the  performance, 
with  but  one  (minor)  inversion. 

As  with  the  8-inch  GRD  results,  there  was  a  sharp  drop  in  perform¬ 
ance  after  Reporting  Level  II — even  to  the  extent  of  precluding  analysis 
at  Reporting  Level  V.  However,  significant  differences  were  found  for  the 
four  compression  levels  tested,  cleanly  indicating  the  detrimental  effect 
of  bandwidth  compression  on  performance.  The  largest  effect  occurred  at 
the  1  bit/pel  compression  level  for  Reporting  Levels  I,  II,  and  III,  and 
at  tne  2  bits/pel  for  Reporting  Level  IV. 
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Table  6 

Analysis  of  Variance  Summary  for  Right 
Identifications,  Independent  Variables  Versus 
Reporting  Level  (16-inch  GRD) 


Independent 

variables 


Reporting  level 
II  III  IV 


Groups 

Periods 


Bandwidth  compression 
level 


*  *  *  * 


Scenario 

Residual 


*  *  *  * 


•Significant  at  the  .05  level. 
••Significant  at  the  .01  level. 

ainsuf ficient  data. 


Table  9 

Number  of  Riyht  Identifications,  Bandwidth 
Compression  Level  Versus  Reporting  Level  (16-inch  GRP) 


Bandwidth  compression 
level 

I 

Re  i 
II 

sorting 

III 

level 

IV 

8  + 

bits/pel 

93 

67 

31 

17 

2 

bits/pel 

89 

61 

20 

7 

-d 

1 

bit/pel 

66 

37 

7 

3 

i 

i 

.  8 

bit/pel 

59 

31 

6 

5 

Insufficient  data. 


Wrong  Identification  Scores.  Table  10  presents  the  analysis  of 
variance  summary  for  independent  variables  versus  reporting  level.  The 
only  independent  variable  on  which  performance  differed  significantly 
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was  bandwidth  compression.  Reporting  Level  V  had  a  significant  residual, 
indicating  that  there  may  have  been  interactions  among  the  independent 
variables . 


Table  10 

Analysis  of  Variance  Summary  for  Wrong 
Identifications,  Independent  Variables  Versus 
Reporting  Level  (16-inch  GRD) 


Independent 

Reporting  level 

variable 

la 

II  III  IV 

V 

Groups 

- 

Periods 

- 

Bandwidth  compression 
level 

- 

* 

* 

Scenario 

- 

Residual 

- 

* 

‘Significant  at  the  .05  level. 
ainsuf f icient  data. 


Table  11  shows  the  number  of  wrong  identifications  for  bandwidth 
compression  level  by  reporting  level.  The  number  of  wrong  identifica¬ 
tions  differed  significantly  among  bandwidth  compression  levels  for  Re¬ 
porting  Levels  IV  and  V.  The  number  of  wrong  responses  decreased  with 
an  increase  in  bandwidth  compression  level  for  these  reporting  levels. 

In  both  experiments,  there  was  a  decrease  in  right  identifications 
associated  with  bandwidth  compression  and  a 1 so  a  decrease  in  wrong  iden¬ 
tifications.  Bandwidth  compression  acted  to  decrease  the  overall  output 
of  interpreters  (total  number  of  identifications  attempted).  As  the 
image  became  more  degraded,  the  interpreter  was  less  able  to  make  the 
more  precise  identifications  and  did  not  attempt  to  do  so. 

Twenty -Four-Inch  Ground  Resolut i on 

Right  Identification  Scores.  Table  12  i -recent*;  the  analysis  of  var 
iance  summary  for  independent  variables  versus  reporting  level  for  the 
number  of  right  identi ricat ions .  Bandwidth  compression  level  is  the  onl 
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variable  for  which  significant  differences  were  obtained.  Table  13  gives 
the  number  of  correct  identifications  for  bandwidth  compression  level  by 
reporting  level. 


Table  11 

Number  of  Wrong  Identifications,  Bandwidth 
Compression  Level  Versus  Reporting  Level  (16-inch  GRD) 


Bandwidth  compression 
level 

Reporting  level 

la 

II 

III 

IV 

V 

8+ 

bits/pel 

- 

21 

26 

22 

22 

2 

bits/pel 

- 

18 

21 

11 

8 

1 

bit/pel 

- 

13 

10 

4 

2 

.8 

bit/pel 

- 

18 

16 

7 

6 

ci 

Insufficient  data. 


Table  12 


Analysis  of  Variance  Summary  for  Right 
Identifications,  Independent  Variables  Versus 
Reporting  Level  (24-inch  GRD) 


Independent 

Reporting  level 

var i ables 

I 

II  III  IV 

ya 

Groups 

- 

Periods 

- 

Bandwidth  compression 
level 

**  *  *  *  * 

- 

Scenario 

- 

Residual 

- 

**Signif icant  at  the  .01  level, 
a 

Insuf t icient  data. 


Table  13 


Number  of  Right  Identifications,  Bandwidth 
Compression  Level  Versus  Reporting  Level  (24-inch  GRD) 


Bandwidth  compression 
level 

Reporting 

level 

I 

II 

III 

IV 

va 

8+ 

bits/pel 

72 

48 

18 

8 

- 

2 

bits/pel 

67 

41 

16 

6 

- 

1 

bit/pel 

54 

17 

3 

1 

- 

.8 

bit/pel 

S5 

21 

2 

0 

- 

a 

Insufficient  data. 


At  Reporting  Level  l,  detection,  the  number  uf  right  identifications 
declined  with  increasing  bandwidth  compression,  although  no  statistically 
significant  differences  were  found.  For  Reporting  Levels  II,  III,  and  IV 
there  was  a  statistically  significant  decrease  in  correct  identifications 
as  bandwidth  compression  level  increased.  As  in  the  previous  experiments 
the  largest  decrease  occurred  between  compression  levels  4:1  and  8:1. 

Wrong  Identification  Scores.  None  of  the  independent  variables  was 
associated  with  a  significant  outcome  at  any  reporting  level;  therefore, 
no  analysis  of  variance  summary  is  given. 

For  comparison  with  other  results,  Table  14  presents  the  number  of 
wrong  identifications  for  bandwidth  compression  level  versus  reporting 
level.  These  data  will  be  used  in  a  subsequent  discussion  and  are  re¬ 
ported  here  simply  for  convenience. 

Effect  of  Image  Variables  on  Interpreter  Performances.  As  described 
earlier,  the  24-inch  ground  resolution  experiment  provided  sufficient  con 
trol  of  target  type  and  size  to  permit  a  rough  equalization  of  target 
difficulty  across  bandwidth  compression  level,  sun  angle,  contrast,  and 
target  obscurity,  making  possible  a2x2x2x4  analysis  of  variance 
design.  The  low  number  of  wrong  responses  precluded  their  analysis.  The 
number  of  right  identifications  were  analyzed  at  Reporting  Levels  I,  II, 
and  III  only.  The  number  of  responses  for  the  other  two  levels  were 
insufficient  to  justify  a  breakout  for  the  2  x  2  x  2  x  4  analysis.  The 
results  of  the  analysis  ais  discussed  separately  by  reporting  level  and 
then  combined.  Since  the  24-inch  ground  resolution  imagery  was  oblique 
photography,  generalization  of  results  to  vertical  imagery  should  be  done 
with  caution. 


Table  14 


Number  of  Wrong  Identifications,  Bandwidth 


Compression  Level  Versus 

Reporting 

Level 

(24-inch 

GRD) 

Bandwidth  compression 

Reporting 

level 

level 

Ia 

II 

III 

IV 

Va 

8+ 

bits/pel 

- 

17 

18 

9 

- 

2 

bits/pel 

- 

23 

15 

6 

- 

1 

bit/pel 

- 

22 

17 

5 

- 

.8 

bit/pel 

- 

20 

11 

4 

- 

a 

Insufficient  data. 


Reporting  Level  I.  Table  If  shows  that  target  obscurity,  sun  angle, 
and  the  three-way  interaction  among  target  obscurity-contrast-sun  angle 
significantly  affected  interpreter  performance.  Table  16  shows  the  fre¬ 
quency  of  correct  responses  presented  by  bandwidth  compression  levt '  ver¬ 
sus  target  obscurity-contrast-sun  angle.  This  table  details  the  two  main 
effects  and  one  triple  interaction  that  were  statistically  significant. 

For  example,  the  number  of  obscured  targets  detected  can  be  determined 
by  adding  the  four  left-hand  column  totals  to  give  the  sum  of  45  correct 
detections  for  obscured  targets.  The  total  of  unobscured  targets  detected 
is  the  sum  of  the  four  right-hand  column  totals,  or  205  target  detections. 
Subjects  detected  more  than  4.5  times  as  many  unobscured  tarcets  as  tar¬ 
gets  obscured  by  vegetation.  Clearly,  a  blob  in  the  open  was  much  easier 
to  recognize  as  a  target  than  the  same  blob  surrounded  by  similar  blobs 
of  vegetation. 

Sun  angle  significantly  affected  interpreter  performance.  The  sum 
totals  of  all  columns  labeled  high  sun  angle  in  Table  23  yield  141  tar¬ 
gets  detected.  Similarly,  summing  the  totals  of  those  columns  labeled 
low  sun  angle  gives  a  total  of  109  targets.  Whan  the  length  of  shadow 
was  short,  as  in  the  case  of  the  high  sun  angle,  the  number  of  corxect 
detections  increased. 

The  triple  interaction  among  target  obscunty-contrast-sun  angle 
significantly  influenced  interpreter  performance.  Table  17  shows  the 
frequencies  of  correct  responses  when  target  obscurity  is  tabulated 
against  contrast  and  sun  angle.  These  data  show  that,  for  high-contrast 
imagery,  the  number  of  correct  detections  for  high  sun  angle  was  greater 
than  for  low  sin  angle  for  both  the  obscured  and  unobscured  targets.  For 
the  low-contrast  imagery,  the  high  sun  angle  resulted  in  the  detection  of 
more  obscured  targets  than  the  low  sun  angle,  but  had  little  or  no  effect 
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on  the  detection  of  unobscured  targets.  This  fact  should  be  of  use  to 
mission  planners  in  deciding  when  to  fly  surveillance  missions.  Trans¬ 
lated  into  operational  terms:  if  the  day  is  bright  and  shadows  are 
sharp  and  distinct,  a  mission  should  be  flown  when  the  sun  is  high:  how¬ 
ever,  if  a  mission  is  required  when  the  day  is  overcast  and  shadows  are 
weak  or  ..onexistent ,  the  mission  can  be  flown  at  any  time  of  day  (given 
sufficient  light),  although  a  few  obscured  targets  may  be  missed. 

Table  15 


Analysis  of  Variance  Summary  for  Right  Identifications, 
Bandwidth  Compression  Level  and  Image  Variables  Versus 
Reporting  Level  (24-inch  GRD) 


A  Bandwidth  compression 

level  **  “  Similar  to  previous  results. 

B  Obscured/unobscured  **  **  **  Few  responses  for  obscured 

targets . 

C  High/low  contrast 

D  High/low  sun  angle  **  **  **  High  sun  c.v,ie  better. 

AB  “  “  see  t 

AC 

AD  *  Low  sun  angle — gradual  de¬ 

crease  due  to  bandwidth 
compression.  High  sun 
angle--abrupt  change. 

3C 

BD  **  **  Few  responses  for  obscured 

targets . 

CD 

ABC 

ADD  *  see  AD  and  B. 

ACD 

BCD  *  See  B  above.  High  contrast 

shows  drop  in  low  sun 
angle;  low  contrast  shows 
no  difference. 

ABCD 


‘Significant  at  the  .05  level. 
“Significant  at  the  .01  level. 


i.LuEMUjiLj  iUl-  i^i:Uiii,:i»  1  ^..1111  ■.iMiblilllmUli  iHl'mliiMhlJit 


Reporting  Level  II.  Table  15  shows  three  significant  main  effects 
for  Reporting  Level  II — compression  level,  target  obscurity,  and  sun 
angle — and  two  significant  two-way  interactions--one  between  bandwidth 
compression  level  and  target  obscurity  and  another  between  target  ob¬ 
scurity  and  sun  angle.  Table  18  shows  the  number  of  correct  identifica¬ 
tions  by  bandwidth  compression  level  versus  target  obscurity  and  sun 
angle . 


Table  18 

Reporting  Level  II,  Number  of  Correct  Identifications, 
Bandwidth  Compression  Level  Versus  Sun  Angle  x 
Target  Obscurity  (24-inch  GRD) 


Obscured  Unobscured 


Bandwidth 

compression 

level 

High  sun 
angle 

Low  sun 
angle 

High  sun 
angle 

Low  sun 
angle 

Total 

8+  bits/pel 

4 

0 

28 

16 

48 

2  bits/pel 

3 

3 

25 

1C 

41 

1  bit/pel 

0 

0 

11 

6 

17 

.8  bit./pel 

1 

0 

13 

7 

21 

Total 

8 

3 

77 

39 

127 

Bandwidth  compression  level  produced  a  significant  effect  on  inter¬ 
preter  performance.  For  the  no-compression  condition  (8+  bits/pel)  and 
for  the  4:1  compression  condition,  the  number  of  correct  responses  was 
relatively  high  (see  Table  18).  For  the  8:1  and  10:1  compression  condi¬ 
tions,  performance  dropped  severely.  This  result  is  similar  to  that 
observed  in  the  previous  analyses. 

Target  obscurity  significantly  altered  performance .  Table  18  shows 
that  only  11  obscured  targets  were  identified  correctly,  whereas  116 
uncbscured  targets  were  identified  correctly.  The  distraction  intro¬ 
duced  by  vegetation  reduced  the  number  of  correct  identifications  by  a 
factor  of  10. 

The  sun  angle  during  the  mission  also  significantly  altered  inter¬ 
preter  performance.  If  the  imagery  was  taken  when  the  sun  angle  was  high 
8h  targets  wore  correctly  identified;  with  a  low— sun— angle  condition,  onl 
42  targets  were  correctly  identified.  A  possiole  reason  for  this  effect 
is  that  target  details  were  hidden  by  the  more  extensive  shadows  produced 
by  the  low  sun  angle. 
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The  most  striking  thing  about  Table  18  is  the  number  of  zero  entries 
in  the  two  left-hand  columns.  Only  11  correct  identifications  were  made 
of  obscured  targets.  The  extremely  small  number  of  responses  makes  any 
interpretation  of  the  interactions  involving  obscured  targets  questionable . 

Bandwidth  compression  level  interacted  with  target  obscurity  to  pro¬ 
duce  a  significant  change  in  interpreter  performance  (Table  19) .  However, 
because  there  were  so  few  correct  responses  for  the  obscured  target  con¬ 
dition,  this  effect  must  be  interpreted  cautiously.  Apparently,  increased 
bandwidth  after  2  bits/pel  had  a  greater  detrimental  effect  on  obscured 
targets  than  on  unobscured  targets. 


Table  19 

Reporting  Level  II:  Number  of  Correct  Identifications, 
Target  Obscurity  Versus  Bandwidth  Compression  Level  (24-inch  GRD) 


Target 

obscurity 

Bandwidth  compression  level 

8+  bits/pel 

2  bits/pel 

1  bit/pel 

.8  bit/pel 

Obscured 

4 

6 

0 

1 

Unobscured 

44 

35 

17 

20 

Total 

48 

41 

17 

21 

Although  the  target  obscurity  by  sun-angle  interaction  was  signifi¬ 
cant,  again  the  interaction  should  be  generalized  cautiously  because  of 
the  small  number  of  correct  responses  for  the  obscured  targets.  A  total 
of  11  targets  were  reported  under  the  obscured  condition,  8  for  the  high- 
sun-angle  condition  and  .1  for  the  iow-sun-angle  condition.  Under  the 
unobscured  condition,  the  frequencies  are  77  and  39.  A  greater,  detri¬ 
mental  effect  of  low  sun  angle  occurred  for  obscured  targets. 


Reporting  Level  III.  At  this  reporting  level,  the  interpreter  iden¬ 
tified  the  type  of  target  detected  (e.g.,  tank,  cargo  truck,  trailer, 
self-propelled  gun).  This  required  the  ability  to  identify  additional 
cues  and  signatures  of  the  target  that  permit  more  detailed  identifica¬ 
tion.  Table  15  shows  that  for  Reporting  Level  III,  there  were  three 
significant  mam  eifects — bandwidth  compression  level,  target  obscurity, 
and  sun  angle--and  four  significant  interactions--bandwidth  compression 
level  by  target  obscurity,  bandwidth  compression  level  by  sun  angle,  tar¬ 
get  obscurity  by  sun  angle,  and  bandwidth  compression  level  by  target 
obscurity  by  sun  angle. 


Table  20  sho-,;s  the  frequency  of  correct  identifications  presented  by 
bandwidth  compression  level  versus  sun  angle-contrast-target  obscurity. 

The  large  number  of  zero  entries  in  Table  20  is,  again,  striking.  Dis¬ 
counting  marginal  totals,  of  the  32  cells  in  Table  20,  21  cells  are  zero. 
With  such  a  large  number  of  zeros,  the  analysis  of  these  data  may  be 
unstable,  and  all  of  the  interactions  cannot  be  validly  generalized. 

Bandwidth  compression  level  was  statistically  significant.  The 
right-hand  column  of  Table  20  shows  the  frequency  of  correct  identifica¬ 
tions  by  bandwidth  level.  This  result  .s  consistent  with  previous  find¬ 
ings  of  this  research  and  shows  that  there  is  a  sharp  decline  in  perform¬ 
ance  between  2  bits/pel  and  1  bit/pel. 

Target  obscurity  had  a  significant  effect:  there  were  37  correct 
responses  for  unobscured  targets,  but  only  2  correct  responses  for  ob¬ 
scured  targets.  The  interpreters  had  great  difficulty  in  making  correct 
identifications  with  the  24-inch  GRD  imagery  when  the  targets  were  embedded 
in  vegetation. 

Sun  angle  produced  a  significant  difference  in  performance.  With  a 
high  sun  angle,  there  were  31  correct  responses;  at  a  low  sun  angle,  there 
were  only  8  correct  identifications.  This  result  is  consistent  with  the 
results  at  other  reporting  levels. 

Table  21  presents  the  significant  triple  interaction  and  shows  the 
number  of  correct  identification  in  each  of  the  16  possible  categories. 
Since  only  two  obscured  targets  were  correctly  identified,  this  signifi¬ 
cant  triple  interaction  probably  occurred  because  one  cell  contained  two 
responses;  i.e.,  there  are  too  few  observations  to  make  a  reasonable 
interpretation . 

Table  21  also  can  be  used  to  examine  the  three  two-way  interactions 
as  well  as  the  triple  interaction.  For  the  interaction  between  bandwidth 
compression  level  and  target  obscurity,  the  values  for  each  bandwidth 
level  can  be  determined  by  adding  the  entries  for  high  and  low  sun  angles 
under  the  obscured  target  heading. and  doing  the  same  for  the  entries  under 
the  unobscured  target  heading.  The  number  of  correct  identifications  at 
a  bandwidth  of  8+  bits/pel  is  two  for  obscured  targets  and  zero  at  all 
other  bandwidth  levels.  For  unobscured  targets,  the  number  of  correct 
identifications  at  a  bandwidth  of  8+  bits/pe.1  level  is  16;  the  numbers 
are  16,  3,  and  2,  respectively,  at  the  ether  three  banawidths.  It  could 
be  argued  that  the  drop  off  in  performance  associated  with  bandwidth  com¬ 
pression  occurred  sooner  with  unobscured  targe's  than  with  obscured  tar¬ 
gets.  Such  an  argument  is  questionable,  because,  again,  too  few  obscured 
targets  were  identified  to  give  credibility  to  such  an  interpretation. 
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Table  21 


Reporting  Level  III:  Number  of  Correct  Identifications, 
Bandwidth  Compression  Level  Versus  Sun  Angle  x 
Target  Obscurity  (24-inch  GRD) 


Bandwidth 

compression 

level 

Obscured 

Unobscured 

Total 

High  sun 
angle 

Low  sun 
angle 

High  sun 
angle 

Low  sun 
angle 

8+  bits/pel 

2 

0 

11 

5 

18 

2  bits/pel 

0 

0 

< 

14 

2 

16 

1  bit/pel 

0 

0 

2 

1 

3 

.8  bit/pel 

0 

0 

2 

0 

2 

Total 

2 

0 

29 

8 

39 

The  bandwidth  compression  level  by  sun-angle  interaction  can  be 
examined  (Table  21)  in  a  manner  similar  to  that  above.  If  the  results 
for  the  obscured  targets  were  added  to  those  for  the  unobscured,  the  only 
change  that  would  occur  from  the  results  with  unobscured  targets  is  that 
the  number  of  correct  detections  at  8+  bits/pel  is  13  instead  of  11.  It 
appears  that  with  a  low  sun  angle,  the  use  of  bandwidth  compression 
quickly  reduces  the  number  of  correct  identifications,  but  that  some 
bandwidth  compression  can  be  tolerated  with  a  high  sun  angle. 

The  final  two-way  interaction  is  the  target  obscurity  by  sun  angle 
interaction.  Here  again,  there  are  too  few  responses  to  make  any  reason¬ 
able  interxjretation . 


Summary  Across  Reporting  Levels 

Combining  these  results  across  reporting  levels  leads  to  the  follow¬ 
ing  conclusions: 

Bandwidth  Compression.  The  nusaber  of  correct  target  identification 
is  significantly  reduced  by  bandwidth  compression;  the  Largest  decrease 
occurred  at  a  compression  ratio  of  8:1  (1  bit/pel) . 
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Sun  Angle.  Detection  and  identification  of  targets  is  facilitated 
by  a  high  sun  angle.  Sun  angle  interacted  with  bandwidth  compression  to 
reduce  the  number  of  correct  identifications  under  low  sun  angle,  but 
had  little  effect  at  low  compression  (4:1)  under  high  sun  angle.  Al¬ 
though  high  sun  angle  is  generally  better,  sun  angle  does  not  affect 
detection  of  targets  (Reporting  Level  I)  under  low-contrast  conditions 
for  unobscured  targets. 

Target  Obscurity.  In  the  digitized  imagery  used  in  this  experiment, 
military  targets  surrounded  by  vegetation  are  extremely  difficult  to  de¬ 
tect  and  identify. 

Other  Interactions.  Inspection  of  these  interactions  revealed  that 
most  involved  target  obscurity  for  which  there  were  few  responses  at  one 
or  both  levels  of  the  variable.  With  so  few  values,  interpretation  of 
these  interactions  was  considered  teguous. 


Summary  Across  GRP  Levels 

The  results  at  each  of  the  three  ground  resolutions  are  summarized 
across  the  three  parallel  experiments,  first  in  terms  of  right  identifi¬ 
cations,  and  then  in  terms  of  wrong  identifications. 

Right  Identifications.  The  number  of  correct  identifications  is 
summarized  in  Table  22  in  terms  of  bandwidth  compression  ratio  at  each 
GRD  for  each  of  the  five  levels  of  reporting.  The  8-inch  and  16-inch  GRD 
images  were  vertical  photographs,  and  the  24-inch  GRD  images  were  oblique 
photographs.  However,  the  effect  on  interpreter  performance  produced  by 
the  vertical/oblique  dichotomy  cannot  be  determined  in  this  research. 

The  data  in  Table  22  are  plotted  in  Figure  1,  providing  a  set  of 
three  curves  for  each  reporting  level — a  separate  curve  for  the  8-inch, 
16-inch,  and  24-inch  GRDs.  (No  plot  for  Reporting  Level  V  was  made,  since 
data  were  available  only  for  the  8-inch  GRD. 

In  Figure  1,  the  bandwidth  compression  factor  is  plotted  along  a 
logarithmic  scale,  and  information  extracted — number  of  correct  responses — 
is  plotted  along  an  equal  division  scale.  The  following  is  the  rationale 
for  plotting  the  results  for  the  16-inch  and  24-inch  GRD  imagery  beginning 
at  4:1  and  9:1  respectively,  on  the  same  bandwidth  reduction  scale  as  for 
the  8-inch  GRD  Imagery. 

Analytically,  there  is  a  logarithmic  relationship  between  bandwidth 
and  the  information  content  of  the  imagdt  Degradation  of  imagery  by  in¬ 
creasing  the  size  of  the  GRD  can  be  assumed  to  have  an  effect  analogous 
to  that  of  bandwidth  compression.  If  the  original  image  has  an  8-inch 
GRD  and  then  is  degraded  photographically  (by  defocusing  or  other  means) 
to  a  16-inch  GRD,  the  degraded  image  reflects  a  change  of  2:1  along  the 
width  and  length  dimensions  of  the  degraded  image.  In  area,  this  is  a 
4:!.  change.  By  a  similar  argument,  the  24-inch  GRD  imagery  represents  a 
1:1  I  inear  change  or  a  9:1  area  change  over  the  8-inch  GRD  image. 
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The  set  of  three  curves  for  Reporting  Level  I  is  in  the  upper  part 
of  Figure  1.  For  the  8-inch  GRD  curve,  the  1:1  compression  ratio  shows 
that  the  interpreters  detected  108  targets,  or  65%  of  those  in  the  imagery. 
At  the  8:1  compression  ratio,  about  50%  of  the  targets  were  detected.  At 
the  8:1  compression  ratio  for  the  24-inch  GRD  curve,  only  27%  of  the  pos¬ 
sible  targets  were  detected.  The  deterioration  of  interpreter  detection 
performance  is  a  joint  effect  of  GRD  and  bandwidth  compression. 

The  second  set  of  three  curves  in  the  upper  portion  of  Figure  1  is 
for  Reporting  Level  II — identification  of  the  target  class  (e.g.,  tracked 
vehicle).  The  1:1  compression  ratio  for  8-inch  GRD  shows  96  correct  iden¬ 
tifications,  or  about  58%,  and  17  correct  identifications  at  the  8:1  com¬ 
pression  ratio  for  the  24-inch  GRD  imagery,  or  about  9%. 

The  third  set  of  curves  in  Figure  1  shows  the  number  of  correct  re¬ 
sponses  for  Reporting  Level  III.  This  level  of  reporting  requires  that 
the  interpreter  designate  the  type  of  military  target  in  general  terms 
(e.g.,  cargo  truck).  Performance  at  this  level  ranges  from  48  correct 
at  the  1:1  compression  ratio  for  8-inch  GRD  imagery  to  2  correct  at  the 
10:1  compression  ratio  for  24-inch  GRD  imagery.  Thus,  the  performance 
range  is  from  about  29%  to  2%  of  the  number  of  possible  identifications. 

The  three  curves  at  the  bottom  of  Figure  1  are  for  Reporting  Level 
IV — identification  by  target  type  (e.g.,  2-1/2-ton  truck).  Here  the  range 
from  highest  to  lowest  performance  is  from  22  at  the  1:1  compression  ratio 
for  8-inch  GRD  to  zero  for  the  10:1  compression  ratio  for  the  24-inch  GRD 
imagery.  Target  type  identifications  ranged  from  13%  to  0%  of  the  number 
of  possible  identifications. 

Based  upon  these  results,  it  appears  that  the  utility  of  bandwidth 
compression  cannot  be  assessed  without  specifying  the  nature  of  the  task 
to  be  performed.  For  Reporting  Level  I,  if  a  level  of  50%  correct  de¬ 
tection  performance  were  considered  acceptable,  then  for  8-inch  GRD 
imagery  all  compression  ratios  would  be  satisfactory,  as  well  as  the 
1:1  and  4:1  compression  ratios  for  the  16-inch  GRD  imagery.  For  detailed 
interpretation  like  that  required  for  Reporting  Level  IV,  performances 
obtained  in  this  research  would  be  unsatisfactory  at  all  levels  of  GRD 
and  at  all  compression  ratios. 

In  respect  to  the  above  performance  figures,  it  should  be  noted  that 
the  image  interpreters  participating  in  these  experiments  had  little  or 
no  previous  experience  with  digitized  imagery.  The  training/practice 
period  used  in  this  research  was  too  brief  to  provide  the  experience 
level  of  an  "operationally  ready"  interpreter.  This  lack  of  experience/ 
training  depressed  performance  below  what  would  be  expected  if  the  in¬ 
terpreters  had  received  a  reasonable  amount  of  training  and  experience 
in  the  interpretation  of  digitized  imagery. 


26 


Wrong  Identifications.  Table  23  summarizes  the  number  of  wrong  iden¬ 
tifications  in  the  same  format  as  that  used  for  the  number  of  right  iden¬ 
tifications.  These  data  are  graphed  in  the  same  manner  as  the  right 
identifications  and  appear  as  Figure  2  and  Figure  3.  Two  figures  are 
used  to  make  the  different  curves  distinct.  Figure  2  shows  the  sets  of 
curves  for  Reporting  Levels  XI  and  IV.  The  alignment  of  the  three  curves 
in  each  set  is  not  as  distinct  for  the  wrong  identifications  as  it  was 
for  the  right  identifications.  The  separate  curves  for  the  three  GRD 
levels  in  a  set  have  been  labeled  to  indicate  the  reporting  level  repre¬ 
sented.  The  three  curves  in  Figure  2  labeled  Level  II  shew  that  there 
were  relatively  few  wrong  identifications — for  the  8-inch  GRD  (10  to  16), 
for  the  16-inc'n  GRD  (13  to  21),  and  for  the  24-inch  GRD  (11  to  23)--but 
the  trend  was  for  the  number  of  wrong  identifications  to  increase  with 
a  reduction  of  image  quality.  However,  curves  for  Reporting  Level  IV 
(Figure  2)  show  a  consistent  decline  in  the  number  of  wrong  identifica¬ 
tions  with  a  reduction  of  image  quality  both  by  GRD  and  bandwidth  com- 
pression--f rom  a  high  of  37  misidentif ications  to  a  low  of  4  misidentifi- 
cations.  Similarly,  for  Reporting  Levels  III  and  V,  the  number  of  wrong 
identif ications  drops  steadily  with  image  degradation  (Figure  3) . 

Thus,  it  appears  that  in  the  more  detailed  interpretation  associated 
with  Reporting  Levels  III,  IV,  V,  the  interpreters  were  able  to  accurately 
judge  the  quality  of  imagery  anu  n-uuce  the  frequency  of  their  identifica¬ 
tions  as  image  quality  was  reduced,  thereby  reducing  the  number  of  wrong 
identifications  (but  unfortunately  also  reducing  the  number  of  right,  iden¬ 
tifications)  .  However,  for  Reporting  Level  II  (gross  target  class  iden¬ 
tification),  the  interpreters  did  not  judge  the  quality  'f  imagery  as 
accurately,  and  consequently  produced  more  wrong  identifications  as  image 
quality  decreased  either  by  GRD,  or  bandwidth  compression,  or  both. 


CONCLUSIONS 


1.  Bandwidth  compression  of  digitized  imagery  of  various  ground 
resolutions  reduces  the  number  of  targets  detected  and  identified  (at 
several  levels  of  detail)  by  image  interpreters.  Although  there  is  soni 
reduction  in  performance  in  the  first  level  of  compression  (4:1),  the 
largest  decrease  is  between  compression  ratios  of  4:1  to  3:1. 

2.  Generally,  bandwidth  compression  reduces  the  number  of  wrong 
target  identifications  made  by  image  interpreters. 


In  the  training  and  practice  period,  the  interpreters  were  instructed 
to  report  only  those  target  identifications  where  they  were  "positive" 
of  their  identifications  or  where,  at  least,  they  felt  them  to  be  the 
"probable"  idem  if ications.  (The  "possible"  level  of  certainty  was  to 

be  eliminated.)  These  instructions  appear  in  Appendix  B.  It  is  possible 
that  this  instruction  mav  have  reduced  the  number  of  wrena  identifications. 
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reduct. on/ resolution  factor  on  number  of  wrong 


Fidiirf  3.  Effort  of  bandwidth  reduction/resolution  factor  on  number  of  wronq 


3.  Detection  and  identification  of  targets  is  generally  reduced  by 
low  sun  angle .  For  the  detection  of  unobscured  targets  under  low- 
contrast  conditions,  however,  sun  angle  has  no  effect.  (Analyzed  only 
for  the  24-inch  GRD  imagery.) 

4.  The  reduction  in  target  identification  due  to  bandwidth  com¬ 
pression  occurs  sooner  at  low  sun  angles  than  at  higher  sun  angles  (4:1 
low  sun  and  8:1  for  high  sun).  (Analyzed  only  for  the  24-inch  GRD 
imagery . ) 


5.  A  large  decrease  in  performance  occurs  if  the  target  is  ob¬ 
scured  (not  in  the  open)  .  Contrast,  however,  has  no  effect  by  itself 
within  the  range  used.  (Analyzed  only  for  the  24-inch  GRD  imagery.) 

6.  Additional  research  is  required  to  determine  the  effects  of 
bandwidth  compression  under  typical  operational  conditions,  that  is, 
those  involving  the  search  function  and  image  interpreters  better  trained 
on  compressed,  digitized  images. 

7.  The  interaction  effects  of  bandwidth  compression,  sun  angle 

and  target  obscurity  should  be  investigated  more  thoroughly  under  typical 
operational  conditions,  particularly  for  8-inch  and  16-inch  GRD  vertical 
imagery . 
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APPENDIX  A 


INTRODUCTION 

Gentlemen,  I  am  Harold  Martinek  of  the  Army  Research  Institute.  I 
am  the  data  collection  and  analysis  part  of  a  research  team  composed  of 
image  interpreters,  engineers,  human  factors  scientists,  intelligence 
personnel,  and  so  forth,  from  several  organizations  such  as  the  Elec¬ 
tronics  Command,  the  U.S.  Army  Space  Programs  Office,  and  of  course,  the 
U.S.  Army  Research  Institute. 

Our  purpose  in  this  research  is  to  make  an  initial  determination  of 
the  effect  of  a  bandwidth  compression  technique  on  the  intelligence  in¬ 
formation  generated  by  image  interpreters.  As  you  know,  one  problem  with 
most  imaging  systems,  particularly  for  mobile  tactical  targets,  is  getting 
the  image  from  the  platform  to  the  interpreter  in  a  timely  manner.  With 
some  platforms  it  is  a  major  problem.  Electronic  transmission  is  an 
answer  but  does  have  some  problems  associated  with  it — one  of  which  we 
are  looking  into  with  this  research;  that  is,  the  efficient  use  of  band¬ 
width.  In  this  electronic  age  we  live  in,  bandwidth  reduction  is  of 
critical  concern  to  the  Department  of  Defense.  By  mysterious  mathemati¬ 
cal  theory,  electronic  black  boxes,  and  computerized  means,  it  is  possible 
to  reduce  the  bandwidth  required  to  send  an  image .  This  bandwidth  com¬ 
pression  technique,  while  saving  bandwidth,  does  affect  the  interpret- 
ability  of  the  image.  The  questions  are,  how  much  and  under  what 
conditions? 

An  initial  attempt  at  answering  these  questions  is  what  we  will  be 
doing  today  and  tomorrow  morning.  You  will  be  asked  to  read  out  image 
chips  varying  in  the  amount  of  bandwidth  compression  used,  in  resolution, 
in  the  number  and  type  of  vehicles  portrayed,  in  contrast,  in  the  sun 
angle,  and  in  the  amount  of  vegetation  around  the  target.  Naturally, 
like  all  imagery,  many  other  factors  are  present  which  affect  interpret- 
ability ,  but  they  are  not  of  concern  in  this  research.  Nor  are  we  inter¬ 
ested  in  your  performance  as  an  individual  but  only  in  how  these  varia¬ 
bles  affect  interpreter  performance. 

ARE  THERE  ANY  QUESTIONS  AT  THIS  POINT  ON  THE  PURPOSE  OF  OUR 
RESEARCH? 

Today,  we'll  look  at  the  target  list,  American  equipment  Mini¬ 
key,  and  the  report  form  you  will  be  using.  Then  we  will  review  the 
imagery  to  give  you  practice  with  representative  samples  of  all  the 
resolutions,  bandwidth  compression  levels,  and  target  types  you  will 
be  working  with  tomorrow  during  the  actual  data  collection  effort. 
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APPENDIX  B 


TRAINING  INSTRUCTIONS 

To  help  insure  objectivity  in  this  research,  I  want  you  to  use  only 
the  words  or  numbers  in  this  Vehicle  Target  List  when  reporting  targets. 

We  have  found  this  procedure  very  helpful  in  past  efforts  to  objectively 
evaluate  the  reports  consistently.  Note  that  there  are  five  categories 
or  columns  of  targets,  going  from  the  very  general  to  the  very  specific. 
The  fifth  column  refers  to  numbers  on  the  U.S.  Equipment  Mini-key  which 
you'll  receive  shortly.  Each  number  is  paired  with  a  picture  of  a  ve¬ 
hicle — the  name,  model  number,  and  measurements  are  given.  The  group 
of  numbers  on  one  line  in  Column  V,  defines  the  word  in  Column  IV  on  the 
same  line.  That  is,  on  the  first  line  number  3,  4,  or  5,  whatever  they 
are  on  the  Mini-key,  define  what  an  APC  is  for  the  purposes  of  this  study. 
Similarly,  on  line  2,  the  numbers  1  and  2  or  some  other  vehicle  similar 
to  these  define  the  term  "APC  Other."  Going  to  Column  III,  the  term 
"APC  Type"  means  the  target  is  either  an  APC  or  an  "APC  Other."  Again, 
going  to  Column  II,  Tracked  Vehicle  is  defined  by  Column  III,  i.e.,  APC 
Type,  SP  Arty,  Tank,  or  Recovery  Vehicle.  Column  I  is  the  most  general 
target  category,  i.e.,  Military  or  Nothing.  The  latter  could  indicate 
that  there  was  nothing  on  the  picture  or  that  there  was  an  unidentified 
object  that  you  are  not  sure  enough  about  to  report  it  as  a  military 
object. 

In  using  this  list  you  should  always  try  to  use  the  most  specific 
term  you  can — if  you  can  label  an  object  as  probably  or  positively  an 
M48  Tank  you  would  find  the  appropriate  number  on  the  Mini-key  and  write 
the  number  down.  Perhaps  you  know  it  is  a  tank  but  cannot  interpret  it 
any  finer — then  report  the  word  "TANK."  Do  not  report  "possible"  ob¬ 
jects — only  probable  or  positive.  That  is,  if  the  object  is  a  "possible" 
M48,  but  a  probable  Medium  Tank  report  Medium  Tank.  As  you  go  from  image 
to  image  and  across  different  levels  of  resolution,  try  to  keep  the  same 
standards  of  reporting — never  reporting  "possible"  targets. 

Use  of  several  levels  of  target  names  like  these  will  allow  us  to 
determine  how  much  information  can  be  extracted  from  an  image  of  a  par¬ 
ticular  type.  Then  we  can  pick  the  compression  level  which  will  allow 
the  interpreter  to  provide  the  information  the  commander  requires.  In 
a  sense,  you  will  be  setting  the  materiel  specifications  for  future 
image  systems. 

ARE  THERE  ANY  QUESTIONS? 

The  following  steps  were  followed  during  this  first  day  of  the  ex¬ 
periment.  These  items  are  not  a  part  of  the  instructions  given  but  were 
used  as  notes  to  keep  the  experimenter  orhcourse.  They  are  listed  here 
for  record  purposes  only: 
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APPENDIX  C 


TEST  PROCEDURES  AND  IMAGERY  DESCRIPTION 


You  will  be  interpreting  only  40  small  image  chips  today  at  each  of 
three  resolutions  for  a  total  of  120  chips .  Essentially,  the  imagery  is 
the  same  as  the  practice  imagery.  Since  each  chip  covers,  on  the  average, 
only  a  100  x  100  foot  square  on  the  ground,  it  can  contain  only  a  few 
targets--say  from  zero  to  about  six  or  seven.  I  estimate  the  whole  job 
should  take  3  hours,  but  4  hours  have  been  allocated.  As  with  the  prac¬ 
tice  imagery,  within  each  resolution  the  bandwidth  compression  level  used 
will  vary — thus  some  images  within  a  group  will  be  harder  to  interpret 
than  others.  Similarly,  the  contrast  and  sun  angle  vary  within  each 
group.  This  imagery  is  different  from  the  practice  imagery  in  that  some 
targets  are  in  the  open  while  others  are  partially  obscured.  The  scale 
varies  from  1:1,000  to  1:3,000,  and  scale  level  will  be  furnished  to  you 
along  with  the  photos.  Two  of  the  groups  of  images  are  vertical  and  one 
is  oblique--additionally ,  the  oblique  is  at  the  poorest  ground  resolution. 
The  format  is  the  same  as  the  practice  imagery. 


Remember  that  some  of  the  imagery  will  be  quite  poor,  and  perhaps 
even  impossible  to  interpret.  Just  try  to  interpret  it  using  the  most 
detailed  description  you  can  from  the  target  list  but  not  reporting  any¬ 
thing  at  the  "possible"  level. 


ARE  THERE  ANY  QUESTIONS? 

NOTE:  Allow  approximately  50  minutes,  followed  by  a  break. 
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APPENDIX  D 


IMAGE  MATRICES  AND  TARGET  LISTS 
Simulation  Output  Nomenclature  Explanation 

Each  image  mosaic  is  annotated  as  shown  in  Figure  D-l  below.  The 
top  row  is  a  mosaic  identification  number.  The  ten  numbers  in  the  next 
four  rows  correspond  to  image  identification  numbers  assigned  to  the  ten 
images  in  the  mosaic.  At  the  bottom  of  each  mosaic  is  an  experiment  num¬ 
ber  501-XXX.  The  mosaic  number  can  be  used  to  locate  other  pertinent 
information  in  Table  D-l,  such  as  resolution,  scenario  group,  and  bit 
rate.  This  information  can  be  used  in  conjunction  with  the  three  ex¬ 
perimental  matrices  given  in  Table  D-2,  Table  D-3,  and  Table  D-4  to 
determine  sun  angle,  contrast,  and  whether  the  target  is  obscured  or 
unobscured.  Table  D-5  to  Table  D-7  show  the  targets  within  each  image 
and  how  they  were  scored  at  each  reporting  level. 
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Figure  D-l.  Image  mosaic  annotation  example. 
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Table  D-5 


.m« wwwwneswRP''  * 


Scoring  Key  for  8-inch  GRD  Imagery 


Photo  # 

Iia 

Ill 

Group  1 

IV 

V 

Remarks 

45 

Tracked 

Tank 

Medium 

19 

M48 

54 

Two  Tracked 

2  SP  Arty 

2  Sp  HOW 

Two  ’15’s 

M55 

57 

Wheeled 

1/4  T  Trk 

1/4  T  Cargo 

56 

M355  or  M38 

58 

Two  Wheeled 

1/4  T 

1/4  T  Cargo 

56 

3/4  T 

3/4  T  Cargo 

49 

M37 

63 

Two  Wheeled 

Cargo  Trk 

2-1/2  T 

46  or  48 

Tank  Trk 

Fuel 

42 

M49 

64 

OMIT 

67 

Two  Wheeled 

1/4  T 

1/4  T  Cargo 

56 

M355  or  M38 

Cargo  Trk 

2-1/2  T 

46  or  48 

M135  or  M211 

68 

Two  Trl, 

Two  Trailers 

2  Special 

Two  41' s 

M107  or  M149 

Arty  and  AC 

Trk 

73 

— 

— 

— 

— 

— 

79 

— 

— 

— 

— 

— 

Group  2 

43 

Five  Tracked 

Five  APC 

Five  APC 

Three  3's 

Type 

Two  5 ' s 

1  Wheeled 

Cargo  Trk 

2-1/2  T 

46  or  48 

OK  M135 

or 

M211 

48 

Tracked 

APC  Type 

APC 

4 

52 

1  Tracked 

SP  Arty 

HOW 

9 

1  Wheeled 

1/4  T  Trk 

1/4  T  Cargo 

56 

M355  or 

M38 

65 

Trl,  Arty, 

AC 

Arty  Towed 

HOW 

100 

M115 

66 

Trl,  Arty, 

AC 

Arty  Towed 

now 

101 

M114 

69 

Two  Trl,  Arty, 

Two  Aircraft 

Two  Fixed 

Two  LI 9 

AC 

Wing 

70 

1  Trl,  Arty, AC 

1  Trailer 

Cargo  Trailer 

57 

M100 

1  Wheeled 

Veh 

1  3/4  T 

3/4  T  Cargo 

49 

M37 

71 

2  Trl  Arty 

,  AC 

Two  Ar  ty 
Towed 

Two  HOW 

Two  93 ' s 

M101 

74 

78 

1  Wheeled 

Cargo  Trk 

2-1/2  T 

46  or  48 

M135  or 

M2 11 

— 

— 

A' 

-- 

— 

aCatogory  I  score  is  number  of  vehicles  i.n  category  II.  In  addition,  score  as 
correct  words  such  as  military,  vehicles,  unidentified  vehicles,  military  ob¬ 
jects,  or  any  higher  category  words. 


Group  1 


Photo  tt 

II 

Ill 

TV 

V 

Remarks 

85 

Tracked 

APC  Type 

APC 

4 

Mil  3 

87 

Four  Tracked 

2  APC  Type 

2  APC 

Two  3 

M75  Parts  of 

2  Tank 

2  Medium  Tk 

Two  19 

M48  Tanks 

90 

Two  Tracked 

2  SP  Arty 

2  SP  HOW 

Two  16 

M5S 

91 

Tracked 

SP  Arty 

SP  HOW 

9 

M108 

97 

Wheeled 

Cargo  Trk 

2-1/2  Ton 

46  or  48 

M34/M35 

100 

Three  Wheeled 

1-1/4  Ton  Trk 

1/4  Ton  Cargo 

56 

38 

1-3/4  Ton  Trk 

j/4  Ton  Other 

53 

Ambulance 

1-Cargo  Trk 

2-1/2  Ton 

46  or  48 

Ml  35 

102 

Two  Wheeled 

1-1/4  Ton  Trk 

1/4  Ton  Cargo 

56 

M  3  8 

1-Cargo  Trk 

2-1/2  Ton 

46  or  48 

Same  image 

as  67 

111 

Two  Wheeled 

1-3/4  Ton  Trk 

3/4  Ton  Cargo 

49 

M  37 

1-Cargo  Trk 

1-2-1/2  Ton 

48 

M  36 

Truck 

Two  Trl ,  Arty 

2-Trailers 

1  Special  Trl 

Not  Listed 

Ml  39 

AC,  TAA 

1-Arty  Towed 

1  Cargo  Trl 

Not  Listed 

Mini 

1  Missile 

One  97 

Honest  John 

120 

-- 

— 

— 

— 

— 

114 

— 

— 

-- 

-- 

— 

Group  2 


86 

Four  Tracked 

Four  APC  Type 

Four  APC 

Three  3 

M75 

One  5 

M  5  9 

92 

Tracked 

Sparty 

SP  HOW 

9 

Ml  08 

99 

Two  Tracked 

Two  Tanks 

2  Med  TK 

Two  19 

Out  of  picture 

101 

Three  Wheeled 

Two  1/4  Ton 

Two  1/4  Ton 

Two  56 's 

M36 

Trk 

Cargo 

One  Cargo  Trk 

5  Ton 

37  or  38 

M56-MSS-M41 

103 

Two  Wheeled 

Two  1/4  Ton 

Two  1/2  Ton 

Two  56 1 s 

M38 

Trk 

Cargo 

Score  two  extra  rights  for 

Category  I  onl; 

105 

Trailers 

Arty  Towed 

HOW 

101 

Same  as 

Arty  k  A/C 

image  66 

106 

One  Tracked 

SP  Arty 

SP  HOW 

9 

Ml  08 

Two  Wheeled 

1-1/4  Ton  Trk 

1/4  Ton  Cargo 

56 

Trk ' s  Same  as 

image  102 

1-Cargo 

2-1/2  Ton 

46  or  48 

112 

OMIT 

OMIT 

OMIT 

OMIT 

OMIT 

115 

-- 

-- 

-- 

-- 

-- 

119 

-- 

-- 

-- 

-- 

-- 

52 


Photo  # 


II 


III 


IV 


Remarks 


Group  III 


81 

Three  Tracked 

2  Tank 

1  Recovery 

82 

Tracked 

APC  Type 

83 

Two 

Two 

Tracked 

Tanks 

93 

Tracked 

SP  Arty 

94 

Tracked 

SP  Ax  ty 

95 

1-Wheeled 

1/4  Ton  Truck 

1-Tracke  1 

SP  Arty 

104 

OMIT 

OMIT 

108 

OMIT 

OMIT 

117 

— 

— 

116 

— 

2  Medium 

Two  19 

M48 

1  Not  m5?8 

One  24 

M88 

APC 

4 

Mil  3 

2  Medium 

Two 

M48 

Tanks 

19 

SP  HOW 

9 

M108 

SP  HOW 

9 

M108 

1/4  Ton  Cargo 

56 

M38  or  M355 

SP  HOE 

9 

Same  as  52 

OMIT 

OMIT 

OMIT 

OMIT 

OMIT 

OMIT 

84 

88 

89 

96 

98 

107 

109 

110 


Group  IV 


Two 

2 

2  Medium 

Two 

Tracked 

Tanks 

Tanks 

19 

Two 

Two 

Two 

Two 

M7S 

Tracked 

AFC  Type 

APC 

3 

Tracked 

sr  Arty 

SP  HOW 

9 

Tracked 

SP  Arty 

SP  HOW 

9 

Wheeled 

Cargo  Trk 

2-1/2  Ton  Trk 

46  or  48 

Trailer 

Arty  &  A/C 

Trailer 

Cargo 

Trailer 

47 

Bird  Dog 

Trailer 

Arty  A/C 

1 

Aircraft 

1  Fixed  Wing 

119 

2  Wheeled 

3/4  Ton  Trk 

3/4  Ton  Cargo 

49 

M  3  7 

1/4  Ton  Trk 

1/4  Ton  Cargo 

56 

M38 

1  Trl ,  Arty, 
AC 

Trailer 

Cargo  Trl 

57 

Ml  00 

Group  I 


1 

Eng  Equip 

Special  Truck 

Eng  Trk 

80 

M59 

Wh  Veh 

Heavy  Truck 

2-1/2  Ton 

46 

M3  5 

5 

Er.g  Equip 

Earth  Moving 

Wh  Em 

84 

Track  Veh 

SP  Arty 

SP  Gun 

13 

M107 

9 

Track  Veh 

Tank 

Medium  Tank 

19 

M48 

TAA 

Arty  Towed 

Missile 

96 

M387 

13 

_ Wh  Veh- 

Semi -Truck _ 

Semi -Fuel 

32 

M30 

TAA 

Arty  Towed 

Missile 

96 

M387 

17 

TAA 

Arty  Towed 

HOW 

101 

Ml  14 

Track  Veh 

AFC  Type 

APC 

2 

Ml  06 

21 

Wh  Veh 

Semi -Truck 

Semi-Cargo 

34 

Ml  2  7 

with  Trailer 

TAA 

Arty  Towed 

Gun 

99 

25 

Eng  Equip 

Earth  Moving 

Wh  Em 

83 

Wh  Veh 

1/4  Ton  Truck 

1/4  Ton  Cargo 

56 

29 

Eng  Equip 

Earth  Moving 

Wh  Em 

76 

Track  Veh 

Recovery  Veh 

M578  Chassis 

22 

34 

_ 

_ 

_ 

_  _ 

35 


Group  II 


Wh  Veh 

Semi-Trk 

w/Trailer 

Semi-Cargo 

34 

M127 

TAA 

Arty  Towed 

Gun 

95 

Eng  Equip 

Earth  Moving 

Tracked  EM 

85 

Wh  Veh 

3/4  Ton  Trk 

3/4  Ton  Other 

51 

Eng  Equip 

Bridging 

Tracked  Brid. 

73 

M48C 

Track  Veh 

Recovery  Veh 

Not  M578 

24 

M88 

Track  Veh 

APC  Type 

APC 

5 

M59 

TAA 

Arty  Towed 

HOW 

93 

Ml  01 

Track  Veh 

SP  Arty 

SP  Gun 

14 

M53 

Eng  Equip 

Earth  Moving 

Tracked  EM 

87 

TAA 

Arty  Towed 

Gun 

99 

M59 

Track  Veh 

Tank 

Med  Tk 

16 

M41 

Wh  Veh 

Tank  Truck 

Water 

40 

mso 

TAA 

Arty  Towed 

Missile 

97 

M386 

Wh  Veh 

Hvy  Truck 

2-1/2  Ton 

46 

M3  5 

Eng  Equip 

Special  Trk 

Eng  Trk 

88 

M29C 

Table  D-7  (continued) 


II 

III 

IV 

V 

Group  ill 

Track  Veh 

Tank 

Hvy  Tank 

18 

TAA 

Arty  Towed 

HOW 

101 

TAA 

Arty  Towed 

Missile 

97 

Wh  Veh 

Tank  Trk 

Fuel 

42 

Eng  Equip 

Special  Trk 

Engineer  Trk 

88 

Wh  Veh 

Heavy  Trk 

2-1/2  Ton 

44 

Track  Veh 

SP  Arty 

SP  Gun 

14 

Eng  Equip 

Earth  Moving 

Wheeled  EM 

84 

Wh  Veh 

3/4  Ton  Trk 

3/4  Ton  Other 

51 

Eng  Equip 

Earth  Moving 

Track  Veh 

S5 

Eng  Equip 

Earth  Moving 

Wh  EM 

84 

Track  Veh 

Recovery  Veh 

M578  Chassis 

22 

Wh  Veh 

APC  Type 

APC 

5 

TAA 

Arty  Towed 

HOW 

93 

TAA 

Arty  Towed 

Gun 

95 

Wh  Veh 

Semi-Truck 
with  Trailer 

Semi-Cargo 

30 

Remarks 


M103 

M114 

M386 

M49 

H29 

M109 

M53 


M578 

M59 
Ml  01 


Photo  # 

II 

III 

IV 

V 

Remarks 

Group  IV 

4 

Eng  Equip 

Earth  Moving 

Wh  EM 

76 

Track  Veh 

Recovery  Veh 

M578  Chassis 

20 

a 

Track  Veh 

APC  Type 

APC  Other 

2 

M106 

TAA 

Arty  Towed 

HOW 

101 

M114 

12 

Wh  veh 

Semi-Trk 

Semi-Cargo 

34 

w/Trailer 

Track  Veh 

SP  Arty 

SP  Gun 

14 

M53 

16 

Eng  Equip 

Earth  Moving 

Wh  Veh 

83 

Wh  Veh 

1/4  Ton  Trk 

1/4  Ton  Cargo 

56 

20 

Wh  Veh 

Tank  Truck 

Water 

40 

M50 

TAA 

Arty  Towed 

Missile 

96 

M387 

24 

Wh  Veh 

Semi-Truck 

Semi-Cargo 

34 

M127 

Eng  Equip 

Spec  Trk 

Eng  Trk 

80 

M59 

28 

Eng  Equip 

Earth  Moving 

Track  EM 

87 

Track  Veh 

SP  Arty 

SP  Gun 

13 

M107 

Track  Veh 
TAA 


Tank 

Arty  Towed 


Med  Tk 
HOW 


APPENDIX  E 


CONTROL  VARIABLE  RESULTS 

So  as  not  to  burden  the  results  section  of  the  report  with  a  dis¬ 
cussion  of  control  variables,  Appendix  E  has  been  prepared.  Signifi¬ 
cant  differences  produced  by  these  independent  variables  are  described 
here  for  the  sake  of  completeness. 


Eight-Inch  Ground  Resolution  Experiment 

Right  Identification  Scores.  Table  E-l  shows  the  analysis  of  var¬ 
iance  summary  for  the  right  identification  scores  by  independent  variable 
versus  reporting  level.  Independent  variables  that  significantly  affected 
interpreter  performance  are  indicated.  Bandwidth  compression  level  has 
been  discussed  in  the  body  of  the  report  and  will  not  be  given  here. 


Table  E-l 

Analysis  of  Variance  Summary  for  Right 
Identifications,  Independent  Variables 
Versus  Reporting  Level  (8-inch  GRD) 


Reporting  level 

Independent  variable 

I 

II  III  IV 

va 

Groups 

- 

Periods 

- 

Bandwidth  compression 
level 

** 

_ 

Scenario 

** 

**  **  ** 

- 

Residual 

- 

**Signif icant  at  the  .01  level, 
a 

Insufficient  data. 
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^FNhCfcLTlNG  PAQE-BLANK 


Table  E-2  shows  the  number  of  right  identifications  per  scenario  by 
reporting  level.  That  scenarios  differ  significantly  among  themselves 
is  not  unexpected.  The  eight  chips  scored  in  the  ten  image  chips  making 
up  a  mosaic  comprise  a  scenario.  The  total  number  of  targets,  target 
size,  target  type,  terrain  characteristics,  and  so  forth  were  controlled 
subjectively  to  make  the  four  scenarios  similar  but  they  were  not  con¬ 
sidered  to  be  physically  equal.  Therefore,  the  number  of  correct  re¬ 
sponses  differing  significantly  among  scenarios  at  each  of  the  four  re¬ 
porting  levels  (where  there  were  sufficient  responses  to  justify  analysis) 
demonstrates  the  fact  that  the  scenarios  are  not  equivalent.  In  terms  of 
interpreter  performance  in  this  study,  it  appears  that  if  the  scenarios 
were  ordered  in  terms  of  difficulty  they  would  range  from  S2»  the  easiest, 
followed  by  S4,  then  S3,  and  finally  Sj.,  the  most  difficult.  For  the 
number  of  right  identifications  there  was  no  significant  difference  among 
groups  for  Reporting  Levels  I  through  IV.  Reporting  Level  V  performance 
was  not  tested  due  to  lack  of  data. 


Table  E-2 


Number  of  Right  Identifications,  Scenario 
Versus  Reporting  Level  (8-inch  GRD) 


Scenario 

Reporting 

level 

I 

II 

III 

IV 

V 

S1 

86 

62 

28 

9 

3 

S2 

109 

36 

50 

25 

12 

S3 

90 

7& 

37 

19 

5 

S4 

102 

84 

46 

25 

10 

Wrong  Identification  Scores.  Table 

E- 

3  gives 

the  analysis  1 
the  different 

summary  data 

for  independent  variables 

versus 

J- -  '  — L-Lic  VAJ.4_J_CL.CUL.  lCVeiS 

Three  variables  were  significant— groups ,  bandwidth  com¬ 
pression,  and  scenarios.  Table  E-4  gives  the  number  of  wrong  identifi¬ 
cations  made  by  the  four  groups  at  each  of  four  reporting  levels.  Re¬ 
porting  Level  V  was  associated  with  a  significant  variation  in  the 
number  of  wrong  responses  produced  by  the  groups.  Groups  3  and  4 
produced  almost  three  times  as  many  wrong  identifications  at  this  scoring 
level  than  did  Groups  1  and  2.  The  groups  of  interpreters  had  been  sub¬ 
jectively  matched  for  ability  by  their  supervisors  and  the  finding  that 
they  are  not  equal  in  this  one  case  indicated  that  the  subjective " equat¬ 
ing  of  the  groups  was  not  perfect. 
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Table  E-3 


Analysis  of  Variance  Summary  for  Wrong 
Identifications,  Independent  Variables 
Versus  Reporting  Level  (8-inch  GRD) 


___ _ Reporting  levels _ 

Independent  variables  la  II  III  IV  V 


Groups 

Periods 

Compression  levels 

Scenarios 

Residual 


•Significant  at  the  .05  level. 
**Signif icant  at  the  .01  level. 

aInsuf f icient  data. 


Table  E-4 

Number  of  Wrong  Identifications,  Groups 
Versus  Reporting  Level  (8-inch  GRD) 


Groups 


_ Reporting  level _ 

Ia  II  III  IV  V 


G1 

20 

19 

18 

14 

r 

"2 

9 

23 

21 

17 

15 

41 

46 

51 

G„ 

8 

19 

38 

45 

a 

Insufficient  data. 
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Table  E-5  lists  the  number  of  wrong  identifications  by  scenario  and 
reporting  level.  As  for  the  right  identifications  tie  number  of  wrong 
ident1 fications  differs  significantly  among  scenarios  for  each  of  the  re 
porting  levels.  This  is  not  unexpected  since  the  scenarios  were  not 
equated  in  terms  of  the  physical  characteristics  of  the  images  involved. 
;xcept  for  Reporting  Level  II,  again  appears  to  be  the  easiest 
scenario. 

Table  E-5 


Number  of  Wrong  identifications,  Scenario 
Versus  Reporting  Level  (8-inch  GRD) 


Ref 

>ortinq 

level 

Scenario 

Ia  II 

in 

IV 

V 

S1 

4 

16 

32 

35 

S2 

29 

13 

14 

12 

£3 

9 

52 

44 

46 

S4 

10 

21 

33 

34 

a 

Insufficient  data. 


Sixteen  *_i nch  Ground  Resolution  Experiment 

Right  Identification  Scores.  Table  E— 5  gives  the  analysis  of  vari¬ 
ance  summary  for  the  right  identifications  by  independent  variables  versus 
reporting  level.  All  of  the  independent  variables  were  associated  with 
significant  differences  at  one  or  more  of  the  reporting  levels.  In  addi¬ 
tion  there  was  a  significant  residual  found  for  the  first  reporting  lev^i 
indicating  that  there  may  be  interactions  among  the  independent  variabl- i 

Table  E-7  shows  the  number  of  right  identifications  for  the  four 
groups  of  interpreters  at  the  various  reporting  levels.  At  Reporting 
Level  III,  the  performance  of  the  groups  differed  significantly.  Group 
4  made  many  more  correct  identifications  than  did  any  of  the  other  three 
groups-.  As  previously  mentioned  for  the  3-inch  experiment,  groups  had 
been  subjectively  equated  by  their  supervisors  so  that  this  significant 
difference  is  not  startling. 


Table  E-6 


Analysis  of  Variance  Summary  for  Right 
Identifications,  Independent  Variables 
Versus  Reporting  Level  (16-inch  GRD) 


_ Reporting  level _ 

Independent  variables  I  II  III  IV  Va 


Groups  ** 

Periods  * 

Bandwidth  compression 

level  **  **  **  * 

Scenario  **  **  * 

Residual  * 


‘Significant  at  the  .05  level. 
“Significant  at  the  .01  level. 

a 

Insufficient  data. 


Table  E-7 

Number  of  Right  Identifications,  Groups 
Versus  Reporting  Level  (16-inch  GRD) 


_ Reporting  level  _ _ 

Group  I  II  in  IV  Va 


76  46  10  5 


80 


50 


12 


4 


Table  E-8  shows  the  number  of  right  identifications  for  the  four 
work  periods  in  the  study  for  each  of  the  reporting  levels.  At  Reporting 
Level  III,  performance  differs  significantly  among  the  work  periods. 

There  were  fewer  correct  responses  in  the  first  period  and  many  more  in 
the  fourth  period,  indicating  that  there  may  have  been  a  practice  effect. 
That  such  an  effect  should  be  evident  at  only  this  one  reporting  level 
out  of  three  experiments  suggests  that  this  may  be  a  chance  occurrence. 


Table  E-8 

Number  of  Right  Identifications,  Periods 


Versus  Reporting  Level 

(16- 

inch 

GRD) 

Reportinq 

level 

Period 

I 

II 

III 

XV 

V& 

P1 

79 

45 

9 

8 

- 

P2 

70 

41 

14 

5 

- 

P  3 

79 

52 

14 

6 

- 

P4 

79 

58 

27 

13 

- 

a 

Insufficient  data. 


Table  E-9  gives  the  number  of  correct  identifications  by  scenario 
versus  reporting  level.  Scenarios  differ  significantly  for  the  first 
three  reportinq  levels.  As  was  argued  for  the  8-inch  experiment,  the 
scenarios  were  made  similar  but  they  could  not  be  made  identical  for 
all  image  and  target  variables.  That  the  scenarios  differ  significantly 
among  themselves  in  terms  of  the  number  of  correct  responses  made  is 
evidence  of  their  lack  of  equality. 

Wrong  Identification  Scores.  None  of  the  control  variables  was 
associated  with  a  significant  difference  in  performance.  The  bandwidth 
compression  variable  was  the  only  independent  variable  for  which  there 
was  significance.  That  variable  is  discussed  in  the  body  of  the  report. 

Twenty-Four-Inch  Ground  Resolution  Expo rime n t 

Right  Identification  Scores.  None  of  the  control  variables  was 
associated  with  a  significant  difference  in  performance. 
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II 

III 

IV 

Va 

S1 
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42 

14 

9 

- 

S2 

86 

57 

27 

11 

- 

S3 

45 

30 

8 

4 

- 

S4 

111 

67 

15 

8 

- 

ainsuf ficient  data. 


Wrong  Identification  Scores.  None  of  the  independent  variables 


was  associated  with  a  significant  difference  in  performance  at  any 
reporting  level. 


APPENDIX  F 


SIGNIFICANCE  TESTS  USING  THE  NEWMAN-KEULS  METHOD 

For  each  situation  in  which  the  bandwidth  compression  variable  pro¬ 
duces  a  significant  change  in  interpreter  performance,  mean  performance 
at  each  of  the  four  levels  of  the  bandwidth  compression  variable  was 
tested  using  the  Newman-Keuls  Method  (5%  level  of  confidence)  to  deter¬ 
mine  which  of  these  levels  significantly  affected  performance. 


Eight-Inch  GRP  Experiment,  Right  Identifications 

At  Reporting  Level  II,  bandwidth  compression  was  associated  with 
significant  variation  in  interpreter  performance.  Mean  performance  at 
all  four  reporting  levels  was  significantly  better  at  the  8+  bits/pel 
level  than  performance  for  any  other  three  bandwidth  compression  levels. 
Any  amount  of  bandwidth  compression  significantly  degrades  performance. 

At  the  .8  bit/pel  level,  performance  was  significantly  better  than 
that  at  1  bit/pel.  This  result  was  contrary  to  expectation. 


Eight-Inch  Experiment,  Wrong  Identification 

At  Reporting  Level  III,  bandwidth  compression  differences  signifi¬ 
cantly  affected  interpreter  performance.  The  8+  bits/pel  and  the  .8 
bits/pel  levels  were  both  found  to.  have  significantly  more  wrong  re¬ 
sponses  than  either  the  2  bits/pel  or  1  bit/pel  level. 


Sixteen-Inch  Experiment,  Right  Identification 

Bandwidth  compression  significantly  affected  performance  for  Re¬ 
porting  Level  I  through  IV.  Differences  for  each  reporting  level  are 
described  separately. 

•  Reporting  Level  I:  At  the  8+  bits/pel  and  the  2  bits/pel  levels, 
mean  performance  was  significantly  better  than  at  1  bit/pel 

and  .8  bit/pel. 

•  Reporting  Level  II:  At  the  8+  bits/pel  and  the  2  bits/pel  levels 
mean  performance  was  significantly  better  than  that  at  1  bit/pel 
and  .8  bit/pel. 

•  Reporting  Level  III:  At  8+  bits/pel,  performance  was  signifi¬ 
cantly  better  than  that  at  the  Ojther  three  bandwidth  compression 
levels.  Additionally,  mean  performance  at  the  2  bits/pel  level 
was  significantly  better  than  that  at  1  bit/pel  and  .8  bit/pel. 
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•  Reporting  Level  IV:  At  the  8+  bits/pel  level,  mean  performance 
was  significantly  better  than  that  at  the  1  bit/pel  level  only. 

For  the  number  of  right  identifications,  performance  did  not  drop 
significantly  with  bandwidth  compression  before  an  8:1  compression  ratio 
was  reached.  This  performance  followed  t  peetations  as  lowered  perform¬ 
ance  was  associated  with  greater  compression.  At  Reporting  Level  IV,  one 
inversion  occurred,  with  performance  at  1  bit/pel  slightly  below  that  at 
.8  bit/pel. 


Sixteen-Inch  Experiment,  Wrong  Identification 

Bandwidth  compression  level  produced  significar.t  differences  in  in¬ 
terpreter  performance  for  Reporting  Levels  IV  and  V. 

•  Reporting  Level  IV:  At  the  8+  bits/pel  level,  interpreters  made 
more  wrong  identifications  than  at  the  1  bit/pel  and  .8  bit/pel 
levels . 

•  Reporting  Level  V:  At  the  8+  bits/pel  level,  interpreters  made 
significantly  more  wrong  identifications  than  at  any  of  the  other 
three  bandwidth  compression  levels. 


Twenty-Four-Inch  Experiment,  Right  Identifications 

Bandwidth  compression  level  was  associated  with  significant  differ¬ 
ences  for  Reporting  Levels  II,  III,  and  IV. 

•  Reporting  Level  II:  The  8+  bits/pel  and  2  bits/pel  compression 
levels  were  associated  with  significantly  better  performance  than 
were  the  1  bit/pel  and  .8  bit/pel  levels. 

•  Reporting  Level  III:  The  8+  bits/pel  and  2  bits/pel  levels  were 
associated  with  performance  means  that  differ  significantly  from 
those  obtained  at  1  bit/pel  and  .8  bit/pel. 

•  Reporting  Level  IV:  At  8+  bits/pel,  mean  performance  was  signifi 
cantly  better  than  for  the  other  three  levels . 
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